! are parabolically induced from a discrete series representation of a proper para- 

;-i ■ bolic subgroup P of G. It is this second step that we shaU concern ourselves 

with. This problem also has two distinct parts. The first is to determine the cri- 
teria for an induced representation to be reducible when P is a maximal proper 
parabolic subgroup. This involves the computation of Plancherel measures. The 
second part is to use knowledge of the rank one Plancherel measures to construct 
the Knapp-Stein i2-group. This gives one a combinatorial algorithm for deter- 
mining the structure of the induced representations. Those irreducible tempered 
representations whose characters fail to vanish on the regular elliptic set are called 
elliptic tempered representations, and are of particular interest. 
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In [6,7,10] we determined the possible -R-groups for Sp2n, SOn, and 
SLn- Here we built upon the work of Keys [18,19]. Arthur gives a criteria for 
determining the elliptic tempered representations in terms of i?-groups in [2]. In 
[15] Herb described the elliptic tempered representations for Sp2n and SOn- 
For S02n she exhibited irreducible tempered representations which are neither 
elliptic nor irreducibly induced from an elliptic tempered representation of a proper 
parabolic subgroup. Such representations do not exist for F = M, [21], and this 
is the first known example of them in the p-adic case. Using some results of Herb 
and Arthur, we described the elliptic representations for SLn and the quasi-split 
unitary groups Un [6,10]. The problem of determining the zeros of Plancherel 
measures has been explored by Shahidi in [24,25,26,27,28,29]. In [29] Shahidi 
determined the reducibility criteria for the Siegel parabolic subgroups of Sp2n 
and SOn- In [24] he determined the criteria for parabolics of S02n whose Levi 
component is of the form GL^ x S02m where k is even. In [9] we determined 
the criteria for the Siegel parabolics of Our joint work with Shahidi [12] has 
determined this criteria for symplectic and quasi-split orthogonal groups in the case 
where M = GLk x G(m), with k even. Our continuing joint work with Shahidi 
will will examine other maximal parabolic subgroups of classical groups. 

Here we compute the possible i?-groups for the similitude group of a non- 
degenerate symplectic, symmetric, or quasi-split hermitian form, defined over F. 
We show that all the i?-groups are elementary two groups (cf. Theorem 2.6). 
Moreover, the i?-groups are all contained in the subgroup of the Weyl group con- 
sisting of sign changes. For GU2n this extends the work of Keys [19]. We then 
undertake the computation of the elliptic tempered representations. Suppose M is 
a Levi subgroup of G. Then, for some collection of positive integers mi, . . . , m^, 
and some m > 0, we have M = M(F) ~ GLmi x ■ • • x GLm^ x G{m)^ where 
G{m) = GSp2m, GU2mi G02m+i, GU2m+i, Or G02m as appropriate (cf. Section 
2). If a is a discrete series representation of M, then the induced representation 
'i'G,M{o') has elliptic constituents if and only if the longest possible sign change 
wq = Ci . . .Cr is in R{cf) (cf. Proposition 3.3). We make this more explicit on 
a case by case basis (cf. Theorems 3.4 and 3.6). If G = 6*02^+1 or GU2n+i, 
then every irreducible tempered representation of G = G(F) is either elliptic, or 
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is irreducibly induced from an elliptic tempered representation of a proper Levi 
subgroup (of. Theorem 3.4). For G = GU2n, GSp2n, or G02m this statement 
fails to be true. We classify those irreducible tempered representations which are 
non-elliptic, and are not irreducibly induced from elliptic tempered representations 
(cf. Theorems 3.4 and 3.6). 

We also show that when an induced representation has elliptic components, then 
the elliptic characters of those components satisfy a particularly nice relation. More 
specifically, suppose k is an irreducible representation of the i?-group i?, and 
tTk is the irreducible subrepresentation of iG,M(o") attached to k [2,19]. Let 
be the restriction of the character of tt^ to the regular elliptic set. Then 
Q% = K,{Ci . . .Cr)Ql, where 1 is the trivial character (cf. Theorem 3.9). This 
result is similar to the ones obtained by Herb in [15], and is in fact motivated by 
that work. 

I would like to thank Freydoon Shahidi and Rebecca Herb for their comments 
on this work. I would also like to thank the Mathematical Sciences Research In- 
stitute, in Berkeley, for providing the pleasant atmosphere in which this work was 
concluded. 

Section 1 Preliminaries. 

Suppose F is a nonarchimedean local field of characteristic zero and residual 
characteristic q. Let G be a connected reductive quasi-split algebraic group 
defined over F. We denote by G the F-rational points of G. We let G^ be the 

collection of regular elliptic elements of G, i.e., the set of regular elements whose 
centralizers in G are compact modulo the center of G. 

We denote by EdG) the collection of equivalence classes of irreducible admissi- 
ble representations of G. We make no distinction between an irreducible admissible 
representation n of G, and its class [tt] in £c{G). If tt G Sc{G), then the dis- 
tribution character of tt is given by a locally integrable function [13] . We let 
be the restriction of 0,^ to G^. We say that tt is elliptic if ^ 0. We 
let S2{G), £t{G), and S(.{G) be the collection of discrete series, tempered, and 
tempered elliptic classes in £c{G), respectively. Then £2{G) C £e{,G) C £t{G). 
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We fix a maximal torus T of G, and let be the maximal split subtorus of 
T. Denote by $ = $(G,Td) the set of roots of in G. Let A be a choice 
of simple roots in $, and let = $''"(G, T^) be the positive roots with respect 
to this choice of A. The choice of A also determines a Borel subgroup B = TU 
of G. If ^ C A, then we let Ao be the split subtorus of determined by 6. 
Then A^i is the split component of a unique parabolic subgroup = M^iNg of 
G containing B. 

Suppose A = Aq for some 9. Then M = M.^ = Zq, (A) is a Levi subgroup of 
G with split component A. We denote by W(G, A) the Weyl group A^g(A)/M. 
If 'u;eVF(G,A), we let w E Nq,{A) be a representative for w. 

Suppose {a,V) e S2iM). Let 

V{a) = {/ e C^{G, V)\f{mng) = a{m)S]I\m)f{g), ym e M, n e N, g e G}. 

Here 5p denotes the modular function of P. The unitarily induced representation, 
Ind^(a), of G on V{a) is given by right translation. Since the class of Indp(a") 
depends only on M and not on the choice of N, we may denote its class by 
^g,m(c)- We now recall the theory of i?-groups which allows us to determine the 
structure of Indp(c7). For more details see [7,11,18,25,30,31]. For a e S2{M), 
we let W{a) = {w E W{G, A)\wa = a}. Here wa{m) = a{w~^mw). Since the 
class of wa is independent of the choice of w, we may denote it by wa. Let 
$(P,A) be the reduced roots of A in P. For (3 e $(P,A), we let Ap be 
the subtorus of A defined by (3. Let = ZG,{Ap). Then M is a maximal 
Levi subgroup of Let = M^j n N, and *P^ = MN^. Then *P^ is 

a maximal parabolic subgroup of M^. Let Hpicr) be the Plancherel measure 
of a with respect to /3 [14,31]. The value of /ip is given by ratios of certain 
values of Langlands L-functions [28] . For our purposes, it is enough to know that 
fip{cr) = if and only if 14^(M^, A) fl W{a) ^ {1} and iMf},M{o') is irreducible. 
Let A' = {pe $(P, A)|/x^((7) = 0}. Then ±A' is a subroot system of $ [5, VI, 
§2, Proposition 9]. Thus, the group W generated by the reflections determined by 
the elements of A' is a subgroup of W{a). Let R — R{cr) — {w E W{a)\ w(3 > 
0, V/3 e A'}. 

Tiu^^^^™ -I -I /T^, C!j-„:„ C!:iu„ „™ r<-»r» or» o<-»l\ zp _ ^ c i' i\/r\ 



ii-GROUPS AND ELLIPTIC REPRESENTATIONS FOR SIMILITUDE GROUPS 5 

have W{a) = R K W'. Moreover, the commuting algebra C{a) of Indp(cr) has 
dimension \R\. □ 

We call R the Knapp-Stein -R-group attached to a. Let w e W{a), and 
choose Tw : V ^ V which defines an isomorphism between a and wa. Let 
wi,W2 e R, and define r]{wi,W2) by Tw^w2 = l{'^ii'^2)TwiTy^.2- Then rj: R x 
i? — > is a 2-cocycle. 

Theorem 1.2 (Keys [19]). 

(a) The commuting algebra C{a) of Iiidp{a) is isomorphic to C[i?]^, the 
group algebra of R twisted by the cocycle 77. 

(b) Suppose rj is a coboundary. Let R be the set of equivalence classes of 
irreducible representations of R. Then there is a natural one-to-one cor- 
respondence, K I — > TT^, between R and the equivalence classes of subrep- 
resentations of iG,M{<y) such that dim/t = dim Homo (tTk, ^G,M(c■))• In 
particular, if R is abelian and rj is a coboundary, then C{a) ~ C[i?], 
and ^G,M(c■) decomposes as \R\ inequivalent irreducible subrepresenta- 
tions. □ 

Let a = Hom(X(M)F,Z) be the real Lie algebra of A. (Here X{M)f is 
the collection of F-rational characters of M .) For weW{G,A), we let = 
{H G a\w ■ H — H}. Let Z be the split component of G, and let 3 be its 
real Lie algebra. Suppose a e S2{M), and let R be the i?-group of a. We let 
aR = n a^,. In [2] Arthur gives an explicit criteria determining when zg,m(c) 

wER 

has an elliptic subrepresentation. We give a weak version of his results which is 
sufficient for our needs. 

Theorem 1.3 (Arthur [2]). Suppose R is abelian and rj is a coboundary. 
Then the following are equivalent: 

(a) ^g,m(c") has an elliptic constituent; 

(b) all the constituents of iG,M(c) ore elliptic; 

(c) there is a w & R with a^, = 3. □ 
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whether they appear as irreducibly induced from tempered representations. If a 
tempered representation is irreducibly induced, we wish to know when the inducing 
representation is eUiptic. The next two results allow us to determine these things. 
We again state a weaker version of Arthur's result (Theorem 1.4) than the one given 
in [2]. 

Suppose M' D M is a Levi subgroup of G satisfying Arthur's compatibility 
condition with respect to A' [2, §2]. Then R' = RnW{yL' , A) is the i?-group 
attached to zm',m(c). If k'&R', then we let t^' to be the irreducible component 
of iM',M{,CF) corresponding to k' . Let 

R{n') = {neR \ n{w) = n'{w)yw e R'}. 

We let tTk be the irreducible constituent of zg,m(<7) corresponding to k. 

Theorem 1.4 (Arthur [2, §2]). Suppose that R is abelian and C{a) ~ C[i?]. 
Then, for any k,' G R', we have 

KeR{K') 

Proposition 1.5 (Herb [15]). Suppose R is abelian and C{a) ~ C[i?]. Let 
TT he an irreducible constituent of icM^)- Then tt = iG,M'{.T~) for a proper 
Levi subgroup M' and some r e St{M'), if and only if a_R 3. Moreover, M' 
and T can be chosen so that r is elliptic if and only if there is a wq & R with 

Section 2. The Similitude Groups and their i?-groups. 

We now describe the possible i?-groups that can arise when G is one of the 
following groups: GSp2n, GOn, or GUn- Thus, G is the similitude group of 
a non-degenerate symplectic, symmetric, or hermitian form. In the last case we 
assume that the hermitian form defines the quasi-split unitary group of rank [^], 
and we let E/F be the quadratic extension of F over which G splits. Denote 
hj X ^ X the Galois automorphism of E over F. We let N{x) — xx be the 
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Let J be the form with respect to which G is defined. Then, if G = GSp2n 
or GOn, 

G = e GLn\ ^gJg = X{g)J for some A(^) e G^}. 
For the unitary simihtude groups 

G = e KesE/F GLn\ ^gJg = X{g)J: for some A(^) e Rbse/f Gm}- 

In each case we call A the multiplier character of G. If c<; is a character of F^, 
then we also denote by to the character of G(F) given by a; o A. We fix the 
following forms for the various G. We let 



We 



V 1 



1\ 



e Me{F). 



Then we take J 



i ) Wr 



if G = GSp2n- For G = GO^, we take 



-Wn 

J = Wn- For the unitary groups, we fix an element y E E with y — —y. Then 
we let 



J^y 



Wn 
-Wn 



if G = GU2n and 



J 



/ ywn 

1 I ifG = Gt/2n+l- 

\y{-wn) 



We wiU often denote GSp2n, G02n, G02n+i, GU2n, or G02n+i by G(n). 
We formally let G(0) = GL^ if G ^ GU2n+i and G(0) = Res^/j. GLi if 

G = GU2n+l- 

Let T be the maximal torus of diagonal elements in G. We given an explicit 
description of T = T(F) in each case. We adopt the convention of denoting a 
diagonal matrix by diag{(a;i, . . . , Xfc)}. If G — GSp2n or G02n, then 



/o 1 ^ 
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If G = G02n+i, then 

(2.2.) T^{dia.g{xi,... ,Xn,X,>^''x-\... ,X'x^^}\xi,XeF''} 

If G = GU2n, then 

(2.3) T = {dmg{xu... ,XnAx-\... ,XxT^)\XeF'',XieE''}, 
While if G = GU2n+u then 

(2.4) T = {diag{a;i, ...,Xn,X, NiX)x-\ N{X)x^^}\xi, A e £;><}. 

In each case we let Td be the maximal F split subtorus of T. For G = GSp2n 
or GOn, we have T = T^. For G = GU2n, Ta is given by (2.1), while 
Td for GU2n+i is given by (2.2). We sometimes denote an element of T by 

t{xi, . . . ,Xn,X)- 

Note that in each case VF(G, T^) is given by 5^ K Z2 . We use standard cycle 
notation for the elements of Sn- Thus, 

(^j)- ^('^l; • • • ; "^m A) I > t(xi, . . . , Xj, . . . , Xj, . . . , X^i, A). 

We let Ci be the i-th sign change, 

Cf. t{xi, ... ,Xn,X) I > t{xi, ... , Xi-l, XX~^, ... ,Xn,X). 

We call any product of the q 's a sign change. We remark that for G = S02n, 
only those sign changes which are products of an even number of Cj 's are in 
VF(G,Td). However, if G = G02m then the sign changes Cj can be represented 
in G. Finally we remark that W{G,Td) = {(ij)) x (cj). 

Let A be the choice of simple roots of in G for which the associated Borel 
subgroup consists of upper triangle matrices. Suppose ^ C A. Let P = be the 
associated parabolic subgroup, and write P = MN for the Levi decomposition of 
P. 

For some positive integers mi, . . . , m^, and some m > we have, 

/'o c:^ i\/r ^\/^^'I7l^ ^. /^t t /^/'™^ 
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where 

\GLm,{E), ifG^GUn. 

In particular, we may assume that M consists of block diagonal matrices. Let 

e:GLmi GLrrn be given by e{g) = ^g~^ (where for GLm^(F), the Galois 
automorphism is of course trivial), and we let s'{g) — Wmi£{g)Wm]- Then we may 
assume that 

M = |diag{5ri,. .. ,gr,g,X{g)e'{gr),. . . ,X{g)e'{gi)} gi e GLmi,g e G{m)^ . 
We may denote an element of M by {gi, . . . , gr, g). Note that 

A = A{F) = {diaglxi/mi, . . . ,XrIm^Jk,X~^Imr ■ ■■Xi^Imi}}, 

where k is chosen appropriately to be 2m or 2m + 1. For 1 < i < r, we let 

i 

bi = J2 '^31 set 6o = 0. For 1 < z < j < r — 1, we let cty = e;,. — eb^.+i, 

i=i 

and = e;,. + eb^.+i. For 1 < i < r, we set 

2e6., if G = GSp2n or GU2n; 

li={ ebi, if G = G02n+1 ov GU2n+i; 

66.-1 + 66., if G = G02n- 

Then $(P, A) = {a^ , Ai}i<i<j<r-i U {7i}i<i<r. 

Note that the Weyl group VF(G,A) is a subgroup of Sr x 1^2- Namely, if 
rrii = ruj, then the permutation: 



m 

W 



fc=l 



is in W{G,A), and the map Wij ^ (ij) gives an isomorphism of this permutation 
group with a subgroup of Sr- For each i, we have the sign change 
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is in W^(G,A). We call Cj a block sign change. The 's generate the subgroup 
Z2 in the semidirect product. Note that, for ((/i, . . . , (7^, g) G M, we have 



w. 



{gi, ■■■gr,g) = {gi, ■■■gj,---gi- ■■gr,g), and 



Ciigi...gr,g) = (gi, . . .Xig)s{gi), . . . ,gr,g). 

Suppose a G S2{M). Then cr ~ ai ® cr2 ® . . . ® (J^ (8) p, for some ai G £2{GLrrn) 
and p G £2(G(m)). Let 0;^ be the central character of Uj. Note that if Wij G 
W^(G,A), then 

(T ~ (Ti (g) ... ® (Jj ... ® CTj ® ... ® (Tr- (g) p. 

If 1 < z < r, then 

Ci(j ~ (ji (g) . . . (g) (jf (g) . . . (g) (Jr- <8) (p <8) a;^). 

Here crf{gi) = ai{s{gi)). Thus, W{a) 7^ {1} if and only if at least one of the 
following holds: 

(2.6) (Ji ~ aj for some i ^ j, 

(2.7) CTj ~ aj and p (g) ujicoj ~ p, or , 
for some subset {ij} C {!,... , r}, 

(2.8) ai. ~ a-f^. for aU j and p (g) ^JJi^i, j - P- 

Note that if (2.6) holds then Wij G W{a). If (2.7) holds then WijCiCj G W^(cr). 
Finally, (2.8) implies YlCi. G M^((j). Note that in (2.7), since a^ ~ uj, we have 



ujr^ if G ^ 



3 

-j-^ iiG = GUn. 
Since 

r F^ if G = GSp2n, G02n, OT GU2n. 

\{G{m)) = \ ifG = G'02n+i; 

[Ne/fE'', if G = G'C/2n+l, 

(see [16,22]), we see that uJiUJj o A = 1 if ~ a^. Thus, (2.7) simply becomes 



We begin the computation of the possible i?-groups with the following standard 

^i- o — A / ( f3 ^ Pf^lTt AM.. /_^ nl 
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Lemma 2.1. The reduced root aij e A' if and only if ai ~ Cj+i- Similarly, 
Pij e A' if and only if ai ~ c^j+i- 

Proof Note that 

- n ^^rn, X GL^,+m,+, X G{m) ~ Mp^.. 

Thus, by the results of Ol'sanskii [23], Bernstein-Zelevinsky [4,33], and Jacquet 
[17], ^M„..,M(c■) and iM0..,M{o') are both irreducible for all a E S^iM). Thus, 
jjLonj{o-) = if and only if there is some w ^ 1 in Wi^sJlc^., A) with wa ~ 

a. If rrii ^ Wj+i, then VF(Mq.^^. , A) = {!}. However, if rui = mj+i, then 
VF(Mq,.^. , A) = {wij,l}, and so //^^^.(cr) = if and only if ~ cTj+i- Since 
= Cj+iaij, we see that fJ,p^^{a) = if and only if fj,Q,.^{Cija) = 0, which is 
equivalent to Uj ~ cr^+i- ^ 

We now show that the i?-group of any a e £2{M) is an elementary 2-group. 
The proof of the following lemma is based on a technique of Keys [18]. 

Lemma 2.2. Suppose w = sc & R, with s & Sr and c e Then s = 1. 

Proof. By conjugating by a sign change, we may assume that c changes the sign of 
at most one 65. in each orbit of s. Suppose s has a non-trivial cycle, which we 
assume is (1 . . . j + 1). If c changes no signs among {e^^, . . . , 65^.^-^}, then we see 
that wa ~ a implies ui ~ a"2 — . . . — (Jj+i- By Lemma 2.1, we see that aij e A', 
while waij < 0. This contradicts the assumption that w E R. Suppose that c 
changes the sign of ei,._^_^. Then wa ~ a implies ui ~ . . . ~ cTj+i ~ erf. So by 
Lemma 2.1, Pij e A'. But wPij = saij < 0, and again we have a contradiction. 
Thus, s = 1. □ 



Suppose that, for some subset B C {1,2, .. . ,r}, we have Cb = Yl ^ ^^ 

j&B 

Set (jJb = n ^j- Then, for each j e B, aj ~ cr|, and p®uiB — P- Let 



Ne/fE"", ifG = G[/n; 
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If (7i ~ 0"? then u)i\f^^px = 1. If G = GSp2m G02m or GU2m then \{G{m)) = 
F"", while if G = G02n+i, or GU2n+i, then A(G(m)) = iV^F^ . Thus, for these 
last two groups, the condition p (g) ujb ^ p is trivial. Therefore, for G = G02n+i 
or GU2n+ii we see that Cb ^ R only if cTj ~ af for each i e B. 

Definition 2.3. Let cr e £2{GLk) and p e E2{G{m)). We say that condition 
'^m,fe,G(cr®p) holds if iG{m+k),GLuxG{m){(^®p) is reducible. Note that a necessary 
condition for A'^ ^^(^((T (8) p) to hold is that p(^u!^^p, where a;^ is the central 
character of a. 

Definition 2.4. If w E W{G,A), then we let R{w) = {a e ^{P, A)\wa < 0}. 
Note that w e i? if and only if w e W{a) and n A' = 0. 

Lemma 2.5. Suppose G = G02n+i or GU2n+i- Suppose P = MN is a par- 
abolic subgroup of G with M = M{F) ~ GLm^ x . . . x GL^^ x G(m). Let 
cr e £2{M), with cr ~ Ui (8) . . . (8) cr^ (8) p. If c & R, and c = Cb = Yl then 

Cj e R for each j & B. 

Proof. Note that, for each j e B, we have R{Cj) C R{c). Thus, if < 

then CbP < 0, and hence f3 ^ A'. Now it is enough to note that, since ccr ~ cr, 
we have aj ~ cr| for each j e 5, and thus e VF(cr). Therefore, (7j e i?. □ 

In order to give an explicit description of the i?-groups, we need to define some 
terms. Let p e £^2(G(m)), and set 

X(p) = {x e (FX/iV,FX)^ |p (8 X - Pi- 
Let 

Ji(o-) = {i\Xm,mi,G{cri'^ p) holds}. 
For each i e Ji{a), we have Ui G X(p). For each x e (F^^/AT^F^^)^ \ ^(p), let 

<^x(<^) = - ^i" '^i\Fx = x}- 
For X = 1 or x ¥■ ^{p)i we set 
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and let d^. = d^{a) = \I^{a)\ be the number of inequivalent CTj for i e Jxi^)- 

For a nonempty subset S C {F^ /NeF^)^, we say that S is minimally p- 
trivial if U X{p), and U X ^ X(p) for any $ C S' C S. We let 

A(a) = 

{S C (F^/TV^F^)^ \ X{p)\S is minimally p - trivial and d^ia) > 1, Vx G S}. 

Let C A(a). We let 

X{{Si, . . . , S'fc}) = {x I X e S'j for an odd number of j}. 

We say that A((t)' is a basis for A((t) if, for every S G A(cr), there is some 
{S'l, . . . , iSfc} C A(a)' with S — X{{Si,... ,Sk}), and A(a")' is minimal with 
respect to this property. 

Theorem 2.6. Let M. be a Levi subgroup of G, with 

M ~ GLm, X ... X GLm, X G{m). 

Suppose a & S2{M), with a a\ ® . . . ® ® p. Let R = R{a). 

(a) // G = G02n+i or GU2n+ij then ~ Z2, with d = di, i.e., d is the 
number of inequivalent ai such that Xm,mi,G{.(^ ® p) holds. 

(b) // G = GSp2n, G02n, or GU2n, then Rc^Z^ with 



d-v>l 



for any basis A(cr)' of A(cr). 

Proof, (a) By Lemma 2.5, is enough to show that Ci e R if and only if z e hie). 
Suppose Ci G W{a). Note that R{Ci) = {aij, (3ij}i<j<^r-i U {7^}- Note that if 
CTj+i ~ CTj, for some j > i, then and /3y e A', and thus Ci ^ i?. Direct 
computation shows that My. ~ ( Y[ GL^^) x G(m + mi). Since Cjcr ~ cr, we 

_, ^ A/ ;f ] — 1,, ;f -v _ ^ „^ J i- rpi ^ TD \c 
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and only if Xm,mi,G{'^i ® p) holds and ai 9^ aj for all j > i, i.e., if and only if 
i e /i(ct). 

(b) Suppose B C {1,2,... ,r} with Cb = Yi ^ By the argument of 

jeB 

part (a), we see that, for each j G -B, Ufc 9^ CTj for all /c > j. Note again that 
Mj. ~ ( n GLmk) X G{m + mj). Therefore, 7^ e A' if and only if Cja ~ a and 

^m,mj,G{<^ p) fails. Since Cja'^a if and only if ~ uj, and 0;^ e X(p), we 
see that those jEB for which ojj e X(p) are all elements of Ii{cr). Let 

i?i = = (C,- \jeliia)). 

Then we have just shown that Ri{a) C i?(cr). If jEB and a;^ ^ X{p), then 
Cj-^W^(a), and thus 7^ ^ A'. Let x e (F^/iV£F^)^\X(p), and define 

i?^(a) = (QC,K,je/^(c7)). 

If aCj e R^ia), then = 1, so CiCj- G ly(cr). Note that R{CiCj) = 

R{Ci)[JR{Cj). Moreover, by the definition of Ix{(^)i and Lemma 2.1, we see that, 
for all k > i and £ > j, the reduced roots aik, aj£, Pik, and Pj£ can not be in 
A'. Since 7^, 7^ ^ A', we see that CiCj e i?, and thus Rx{(^) Q R- 

Since each Rxio') C R{(t), we can multiply by an element C of 

so that Cb' = C'Cb has the property that B' fl Ii{(t) = 0, and Ui ^ ouj for all 
i ^ j in S'. Since a;^ e X(p), we see that {cujlpx \j £ -B'} can be partitioned 
into minimally p-trivial subsets. For each x ^ iNeF^\F^)^\X{p), with > 0, 
we fix an ix ^ ^xi^)- ^ ^^'^ define Cs — Yl ^i^. Since 11 X ^ 

X(p), we see that Cs e and by the definition of Ix{'^)i we see that 

Cs e -R. Suppose C = Cd E R has the property that {wjIfx Ij ^ -D} = S and 
l^l = \S\. Then 
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and each CjCi^, G R^.{a). Thus, aU the factors in the product are in R. Fix 
a basis A(a)' for A(cr). Suppose S E A(o-), but 5* ^ A(o-)'. Then 5" = 
X{{Si, . . . , Sk}) for some {^i, . . . , ^fe} C A((t)'. By the definition of Cs, and of 
X{{Si, Sk}), we have Cg = Cs.Cs, ...Cs,. Thus, for some {Su ...,Se}C 
A((t)', and some C" E Yl -Rx(^)' we have Cb' = Cs^ ■ ■ -Cs^ ■ C" . Therefore, 

if we define 

R\a) = {Cs\SeA{ay}), 

then we have seen that 




Moreover, by considering central characters, this is a direct product. Therefore, 
as claimed. □ 

Remark. If G = GU2ni then N^F^ = Ne/fE^ is of index two in , and 
so the local class field theory character oje/f is the only non-trivial element of 
{F^ /NgF^)^. Therefore, the group R' is trivial, and R ~ Z2, with d — di, 
or di + d^^^p — 1 depending on whether or not d^^^^ = or not. We note the 
similarity between the i?- group structure for GU2n and that for S02n- We will 
see that the theory of elliptic representations for GU2n also parallels that that of 

S02n- 

Section 3 Elliptic Representations. 

We now describe the tempered elliptic representations of G. We first show that 
the 2-cocycle r] oi R described in Section 1 is trivial. We use an idea from [26] . 

Lemma 3.1. Let G = GSp2n, GOn, or GU^. Suppose M is a Levi subgroup 
of G and a G £2{M). Denote by R the R-group associated to iG,M{o')- Then 
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Proof. Suppose that G ^ G02n- Let Gi(n) = {g e G(?i)|A(^) = 1}°. That is, 
Gi(n) is the symplectic, special orthogonal, or quasi-spHt unitary group associated 
to the form J. Let Mi be the Levi component of Gi(n) given by Mi = 
MnGi(n). If 

M = GLm^ X • • • X GLm, X G(m), 

then 

Ml = GLm^ X • • • X GLm, X Gi(m), 

Let Pi = MiN. Suppose that r is an irreducible subrepresentation of (j\mi- 
Then r ~ a"i • • ■ (8> (Jj- pi, for some irreducible component pi of p\Gi(rn)- 
Let ^(zv, T, tu) and ^(i^, cr, tu) be the standard intertwining operators attached to 
either a and r, respectively. [19,25,28]. Since NcGi{n), {A{i', a,w)f)\Gi = 
A{y,T,w)f\Gx fo^ / ^ Indp(r). Thus, for each reduced root we have 
jjLp^a) — jjipir). We let A'ij^w) and .A'(a", be the normalized self intertwining 
operators (see [10,15]). Then these operators satisfy 

A! {(J, W1W2) = 'niwi, w2)A!{(j, wi)A!{(j, W2) 

for each wi,W2 G Rio-), and 

A'{t, W1W2) = r]{wi,W2)A'{T,Wl)A'{T,W2) 

for wi,W2 e R{t). 

Note that each element of R can be represented by an element in Gi. Suppose 
that Cb & R- Then for each i e B, o-j ~ uf. Thus, by the results of [7] and 
[6], we have Cb e W{t). If CbP < 0, then /if^ia) ^ 0, and thus //^(r) ^ 0. 
Consequently, Cb G Ri'T)i i-e., -R(c) C R{t). Now let i(;i,i(;2 £ -R(c)) and 
/elnd^(a), and /i = /|gi- Then 

?7(t(;i, t(;2)^'(a-, t(;i)^'(a-, W2)f\Gi = A'{wiW2, cr)f\Gi. 

Thus, 

r]{wi,W2)A\wi,T)A'{w2,T)fi = .4'(wiW2,t)/i. 

On the other hand, the results of [6,15] show that 
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and thus r]{wi^W2) — 1- 

We are left to prove the lemma for G = G02n- The problem with the above 
argument is that there may be i?-group elements which are not elements of the 
Weyl group attached to the corresponding parabolic subgroup of S02n- We can 
remedy this by looking at restriction to Mi as above, and inducing to 02n- Let 
Gi = S02n, and take Mi = MnGi, and Pi = PnGi as above. Let G2 = 02n- 
If m > 0, then for each i with rrii odd, we choose the representative for Cj as in 
[7]. Then Cj also represents an element of VF(Gi, Ai), where this is the obvious 
Weyl group. Suppose a e S2{M), and r is an irreducible subrepresentation of 
cj|mi- In [8] we examine the decomposition of the representation 



In [1] , Arthur extends the definition of the unnormalized intertwining operators 
A{i', T, w) to the case of disconnected groups whose component group is cyclic. 
Consider these operators for G2. Since N C G2, this integral operator is again 
the same one which gives the unnormalized operators A{i>,a,w) for G02n- In 
the general case, Arthur did not prove the analytic continuation of these operators. 
However, since A{v,a,w) can be analytically continued, and A{v,a,w)f\G2 — 
r, «))(/! G2), we see that indeed the operators for G2 can be analytically 
continued. 

Let Cb ^ R- Then Cb can be represented in G2, and is a representative 
for an element of VF(G2, Ai). Moreover, from the results of [7,8], Cbt ~ r. We 
claim that Cb G -RgjI^"), where this last object is the i?-group given in [8] which 
determines the structure of Ind p^{t). It is enough to show that if i e B, then 
|J,-y^{T) ^ 0. If Ci represents an element of VF(Gi,Ai), then the argument used 
for G02n+i, GSp2ni and GUn above shows that |J,^^{T) = iJ,^^{a). Thus, we are 
reduced to the case where rrii is odd, and m = 0. Then, since VF(M-y., Ai) = {!}, 
we have H-^iij) ^ 0, as pointed out in [7]. Thus, C_b € RG2{cr)- 

Now, the operators A'{w,a) restrict to elements A'{t,w) of the commuting 

algebra of Indp^^(r). Thus, the cocycle rj also determines the composition of 
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which intertwine r and wr, and rj is also the cocycle that arises in this way. 
The argument given in Proposition 2.3 of [15] shows that, we can choose for 
each w in Rg^{t), satisfying T^r = wtTI^^, with T4^„2 = T^^T^^- But this 
shows that 

A'{wiW2,t) = A'{wi,t)A'{w2,t), 
and therefore rj = 1. This completes the lemma. □ 

Corollary 3.2. For any aES2{M), the induced representation iG,M{cr) decom- 
poses as a direct sum of \R\ inequivalent representations. □ 

Proposition 3.3. Let G = GSp2n, GO m or GUn- Suppose M is a Levi sub- 
group of G, with M ~ GLmi x ... x GLm^ x G{m). Let a e S2{M) with 
a ai® . . .®ar® p. Suppose R is the R-group attached to ^G,M(c■)• Then the 
following are equivalent: 

(a) ^g,m(c) has an elliptic constituent; 

(b) all the constituent of iG,M{o') are elliptic; 

(c) Ci . . . a e i?. 

Proof. By Lemma 3.1, and Theorems 1.3 and 2.6, conditions (a) and (b) are equiv- 
alent. Furthermore, both are equivalent to dui — d = {0} for some w E R. Note 
that 

a = {diag{a;i/mi, . . . ,a;r/m,,Ofc, -a^r-^m,, • • • , -xilmi}\xi G M}, 

where k = 2m or 2m +1 as appropriate. We may denote an element of a by a; = 
(xi, . . . , Xr). We further note that C^: (xi, . . . , x^, . . . , Xr) ^ (xi, . . . , — x^, . . . , x^). 
Thus, if C = Cs, we have ac — {{xi, . . . ,Xr)\xi = 0,Vi e B}. Consequently, 
ac = {0} if and only if S = {1, . . . , r}. □ 

We now give more explicit criteria for iG,M(c) to have elliptic components. In 
order to do this, we need to consider three cases. The first two are handled in 
the next result, and are similar to the results of [15]. We use the same type of 
arguments found there. 

Theorem 3.4. 
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(i) Conditions (a)-(c) of Proposition 3.3 hold if and only if R'^ Zg. 

(a) If TT e £t{G), then either tt G SeiG), or there is a proper Levi 
subgroup M' of G and some t' & £e{M') with TT = iG,M'{T). 
(b) If G = GU2n then the following hold: 

(i) Conditions (a)-(c) of Proposition 3.3 hold if and only if d = r — 1 
and c^wb/f > zs even, or d = r and du,j^/p = 0. 

(a) If d < r — 1, or d = r — 1 and du,^/^ = 1, then each irreducible 
subrepresentation tt of zg,m(c) is of the form tt = iG,M'{T)i for 
some proper Levi subgroup M' of G, and some r e £t{M'). We 
can choose M' and r with r e E^i^M') if and only if (i^^/p, is 
even or dui^/F = 1- 

(Hi) Suppose d = r — 1, d^jj^^p > 3 is odd, and tt is an irreducible 

subrepresentaMon of «g,m(o")- Then n cannot be irreducibly induced 
from a tempered representation of a proper Levi subgroup. 

Proof, (a) From Lemma 2.5, we see that if G = G02n+i or GU2n+ii then 
Ci...Cr e R if and only if i? = (Cj|l < z < r) ~ Z^. Thus, (i) holds. Further, 
Lemma 2.5 implies that for any a e £2{M)., there is a subset of {1,2,... , r} 
with R = {Ci\i e B^). Let C = Cb^. Then 

cii? = {{xi, ■ ■ ■ ,Xr)\xi = 0, Vz e B^} = (Xc- 

Thus, Theorem 1.5 implies (ii). 

(b) Let d2 — dwE/F- remark following Theorem 2.6, we know that 

R ~ Z^i+'^2-^ if d2 > 0, and R ~ Z^' if da = 0. So, if da = 0, we have 
Ci . . .Cr E R if and only if Ci E R for each 1 < z < r, which is equivalent to 
i? ~ Z2. On the other hand, if ^2 > 0, then the longest element of R consists of 
di + 2[^] block sign changes. Hence, if d2 is odd, it is impossible for Ci . . .Or G 
R. On the other hand, if ^2 is even, then we see that Ci . . .Or & R if and only 
if di + d2 = r, which is equivalent to ~ '^2^^- This proves (i). 

We note that if d < r — 1, then there is some i G {1, . . . , r} for which CiCs ^ 
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= (0, . . . , 1, . . . , 0) is in aw (Here the 1 is in the i-th coordinate.) Thus, 
Ei G aR, which imphes an ^ {0}. Therefore, by Theorem 1.5, every irreducible 
subrepresentation tt of zg,m(c) is of the form 7r = ZG,M'(T) for some M' C G 
and T e £t{M'). 

Suppose now that d2 = d^j^^j^ is even. Let l2{(j) — IuiE/p{o'). Then 

is in R. So if B — U hio'), we have Cb ^ R, and = Oi?- Therefore, 

if d < r — 1 and (i2 is even, then we can choose (M', r), with r e £e{M'). 

Suppose that d2 = 1. Then uje/f ^ -^(p)- If = ^e/Fi then CiCb ^ -R, 
for all 5 C {2, ...,r}. Let C = C/^(cr). Then a/? = Oc, and therefore we can 
choose (M',t) and t G £e{M'), with 'n — iG,M'{j)- 

Now suppose (^2 > 3 is odd. Without loss of generality, we assume that Ji (cr) = 
{/c+1, /c+2, . . . , /c+di}, and /2(a) = {/c+di+1, . . . , r— 1, r}, with k = r—{di+d2)- 
Then = {(xi . . .Xr)\xk-^i — Xk+2 = ■ ■ ■ = = 0}. Since Ck+i . . .Cr ^ R, we 
see that an 7^ ayj for any w e R. Therefore, tt can not be of the form zg,m' (t) 
for some M' C G and r e £e{M'). □ 

Definition 3.5. Let G = GSp2n or G02n- Suppose (7~cri(8)---(8)cr^<8)pe 
£:2(M). We set 

0(G,ct) = |x e (fx/fx')^ \x(p) I d^ is odd I . 

We also set 

Oi(G,a) = {xeO(G,a) I = andx^-S, V5 e A^} . 
Finally, we let /o(cr) = /i(ct) U |J /^((t)- 

Theorem 3.6. Suppose G = GSp2n or G02n- Let M ~ GLmi 

G{m). Assume that cr ~ cri (8) • • • (8) cr,. (8)p G £^2(-^) ond i? zs i/ie R- group of a. 
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(i) 0{G,a) can be partitioned into minimally p-trivial subsets, and 

(ii) h{a) = {l,...,r}. 
(b) Suppose TT e ^t{G) is not elliptic, and tt C iG,M{o')- Then we can find 
a proper Levi subgroup M' of G and a t & £t{M') with tt = iG,M'{T~) 
if and only if Io{cr) C {1,... ,r}, or Oi{G,a) is nonempty. We can 
choose (M',t) with t & Se{M') if and only if 0{G,a)\Oi{G,a) can be 
partitioned into minimally p-trivial subsets. 

Proof, (a) If Ci . . . Cf- e -R, then Io{a) = {1, . . . ,r}. So condition (ii) is trivial. 
Suppose this is the case. For each x ^ 0{G,a).i we choose an e {1, . . . , r}, 
with = X- We then let 

Since is odd, C^^ e R. For each x ^ X(p) with d^ even, we let 

= JJ^ Ci. 

Finally let 

co= ( n ^0 n 

\ieli{a) J x^X{p) 

Then Cq G -R, and 

Co = n 

mi^\xeo{G,<T)} 

Thus, Ci . . . e i? if and only if C" = H e i?. From the proof of 

0{G,a) 

Theorem 2.6, we know that C' ^ R if and only if H "^i — 11 X ^ ^(p)- 

0{G,a) ^ 0{G,a) 

This shows that (i) and (ii) are equivalent to Ci . . .Cr E R. 
(b) Note that 



Oi? = Pi a^, C {(a;i . . .a;^) I a^i = 0, Vz e /o(cr)} • 
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So in particular, if /o(cr) C {1,... ,r}, then an 2 {0}- Thus, in this case, we 
can find M' and r G £t{M') as desired. Now suppose that = {1, . . . , r}. 

If X ^ -^(p) ^'iid = = X for some z j, then C = CiCj & R and 
cic = {(a;i . . . a;r)|a;i = = 0} C an. Therefore, if ^ 1 for aU x ^ ^{p) 
then we see that = {0}, and so ig,m'{'^) = ti" is impossible. So now suppose 
001= X and oji^ X for all i > 1. Then there is a subset S C {2, 3, . . . , r} with 
CiCb e -R if and only if ujb = X, which is equivalent to {x}U{c<;j|j G -B'} G A(a") 
for some S' C {2, . . . , r}. Thus, if no such B' exists then {(1, 0, . . . , 0)} G au, 
and we can choose M' and t E £t{M') with tt = zcm' (t). On the other hand, 
suppose that, for each x with = 1, there is an S E A(cr) with x G -S. 
Then, for each 1 < i < r, there is a subset B of {1, . . . , i — 1, i + 1, . . . , r} with 
CiCb G -R. Thus, for each i, {(xi . . = 0} C a_R, which implies = {0}. 

Therefore, finding M' and r is impossible. 

Finally, we assume that an = {(xi, . . . , x^, 0, . . . , 0)|a;i G M}, with k >1. We 
need to determine when Ck+i ■ ■ - Cr G i?. Let x ^ ©(G, a). If x ^ Oi{G,a), 
and = Xj then i^. < k. For all other x ^ if ^ G Ixi'^)^ then we 

have i > k. Suppose x ^ (t)\Oi(G, cr). As in the proof of part (a), we fix 

*e-fx(<^)\{»x} 

If x^C>(G,(7) let 

Cx= JI C'i- 

Set 

Co= n 

Then Co G R. Since 

C'fc+i . • • = Co • JJ^ Ci^, 

xeO{G,a)\0^{G,a) 

we see that C/s+i . . .Cr E R if and only if 
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which says that 0{G,a) \ Oi(G, a) can be partitioned into minimally p-trivial 
subsets. □ 

Example. We note that in all previous cases where the elliptic tempered represen- 
tations were determined, the following phenomenon always held: Given a parabolic 
subgroup P = MN of G, there is a fixed finite group Rm, so that, for any 
cr e £2{M), the representation zg,m(c) has elliptic components if and only if 
R{cr) ~ Rm- In fact, if M is a Levi subgroup that admits elliptic tempered rep- 
resentations, then iG,M{'^) has elliptic constituents if and only if |-R(cr)| = \Rm\- 
With the similitude groups, we see that such Rm do not exist. We look at 
the following example. Suppose that G = GSpen or GOen for some n, and 
M ~ GLn X GLn X GLn X GLi. Let cr ~ ui (8) cr2 <8) crs <8) P- In this case p is 
a one dimensional character, so p ® uj = p if and only if uj = 1. We suppose 
that the are pairwise inequivalent discrete series representations of GLn{F), 
and that ~ ~ af for each i. Here ai is the smooth contragredient of ai 
[3, §7]. If AVi,o,G(ci ® p) holds for each i, then i? ~ Z2 x Z2 x Z2, and iG,M(c) 
has eight elliptic constituents. On the other hand, if Xn^o^oio'i (8) p) holds, while 
<^2 = <^3 7^ I5 then R =< Ci, C2C3 > . Since C1C2C3 e R, we see that icui^) 
has four elliptic constituents. Finally, if the uji are all non-trivial, and — LO1UJ2, 
then R =< C1C2C3 >, and iG,M(c) has two elliptic constituents. □ 

Suppose now that G is any of the similitude groups that we have been studying. 
Further suppose M is a Levi subgroup of G, and a e S2{M) is such that all 
the constituents of zg,m(c) are elliptic. Let R be the collection of irreducible 
representations of R. Since R is abelian, dim k = 1 for all n e R. We let tt^j 
be the irreducible subrepresentation of iG,M{cy) canonically parameterized by k 
[19], and we denote by its character on the regular elliptic set of G. Then we 
see that 



k£R 

Wc now make this linear dependence precise by generalizing an argument of Herb 
[15]. We need some preliminary results. 
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i < r, let Mj be the standard Levi component of G, with split component A^, 
such that Mi ~ GLrm x G{n — rrii), and W{G,Ai) — (Ci). Then the R-group 
Ri attached to iMi,M{(^) is of order ^2"^. 

Proof. Since iG,M{<^) has elliptic constituents, Ci . . .C^ e i?, and thus A' = 0. 
Therefore, Mj satisfies Arthur's compatibility condition, which implies Ri = 
i?nVF(Mj,A). Suppose i? = (si, . . . , Sd). We assume that si = CiCB for some 
S C {1, . . . , z — 1, z + 1, . . . , r}. We claim that it is possible to choose {si, . . . , sa] 
so that si is the only generator of this form. For j > 1, we suppose that 
Sj = Csj- Set s'j = Sj if i ^ Bj, and Sj = siSj otherwise. Then {si, S2, ■ ■ ■ , s'^} 
is a set of generators of the desired form. Therefore, Ri = R f] VF(Mj, A) = 



Lemma 3.8. Suppose that M ~ GLmi x • • • x GLm^ x G{m). Let a e SiiM), 
and suppose that icM^cr) has elliptic constituents. We further suppose that R = 
R{a) ~ Z2. Then there is a set of generators Q — {si, . . . , sa} for R so that, for 
each i, Q\{si} generates Rj^, for some ji. 

Proof. By Lemma 3.7 we can choose a set of generators {sn, . . . , sid} for R with 
^ji ■^12) • • • ) sid > for some ji. Now suppose 1 < k < d, and we have chosen 
a generating set Qk = {ski, • ■ ■ , Skd} for R with the property that, for each 
l<i<k the set nfeVlsfci} generates i?^. for some ji. Suppose Sk{k+i) = Cb, 
for some B G {1, . . . , r}. Since 



we know that ji ^ B for each 1 < i < k. Fix jk+i G B. Suppose that i k + 1 
and Ski — CBi- For i ^ k + 1, we let 



and take S(k+i){k+i) = Sk{k+i)- Set Qk+i = • • • , S(fc+i)d}- By our choice 

of Ofe, and by Lemma 3.7, we see that for 1 < i < k, the group Rj^ is 




d-l 



□ 



k 

Sk{k+i) ^ n 
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that jk+i ^ Di, for i^k+1. Thus, Rj^^^ is generated by O^+i \ {s(fc+i)(fc+i)}. 
Consequently, by induction, we can choose Q — with the desired property. □ 

Theorem 3.9. Let G = GSp2n, GOn, or GUn- Suppose M is a Levi subgroup 
of G, with M ~ GLmi x . . . x GLm^ x G{m). Further suppose that a e S2{M) 
satisfies conditions (a)-(c) of Proposition 3.3. Let R = R{a). Suppose k & R 
and that tt^ is the irreducible subrepresentation of ^G,M(c■) parameterized by k. 
Denote its character on G^ by @%. We set wq = Ci . . . C^, and let €{k) = k{wo). 
Then 0^ = £(«;)Gf , where 1 is the trivial character. 

Proof. By Lemma 3.8, we can choose a set of generators Q = {si, . . . , Sd} for 
R with the property that \ {si} generates Rj^ for some ji. We fix a choice 
of such an Q. Let k E R. Denote by s{k) the number of Si E fl for which 
K{si) = —1. If s{k) = 0, then k = 1, and the claim is trivially true. Assume that 
the statement of the theorem is true whenever s{k) < s. Suppose that s{k) = s+1. 
Without loss of generality, we suppose that k{si) = —1. We are assuming that 
< S2, ■ ■ ■ , Sd >= Rj for some j. Let kj = k\r.. If C ^ -^i) then 

%) = {xe^ixifl, = e} = {e+,r}, 

where is determined by C^(si) = ±1. Note that n = kJ , and consequently 
s(ac^) = s{k) — 1 = s. Therefore, by our induction hypothesis 6^+ = e{Kj')<dl. 

Let T«^. be the irreducible subrepresentation of iMj,M{o') parameterized by Kj. 
Then, by Theorem 1.4, we have iG,Mj i^Kj) = '^^+ ®^«;^ ' thus, 0^ = —0^+ = 

3 3 j 

—e{K^)Q\. It is enough to show that £(k) = — £(av^). To see this, write wq — siw, 
with w E Rj. Now we have 

€{k) = k{wo) = k{si)k{w) = -K'f{si)K'^{w) = -K'f{wo) = -s{k'^). 

Therefore, 0^ = £(K;)0f , and the theorem follows by induction. □ 
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